FAST, BLIND EQUALIZATION TECHNIQUES USING RELIABLE SYMBOLS 



CROSS-REFERENCE TO RELATED APPLICATIONS 

This application is a continuation-in-part of the following applications: U.S. Patent 
Application No. 09/836,281, filed April 18, 2001, WIPO 0/02634, filed July 10, 2000 
(which benefits from the priority of UK application 16938.3, also filed July 10, 2000), 
and WIPO 00/02648, filed July 10, 2000 (which benefits from the priority of UK 
application 9926167.4, filed November 4, 1999), the disclosures of which is 
incorporated herein by reference. Certain claims may benefit from the priority of these 
applications. 

BACKGROUND 

The present invention relates to an equalization technique useful for transmitting 
symbols of high-order constellations that are subject to corruption by inter-symbol 
interference and other data correlated noise (collectively, "ISI"). ISI refers to a variety of 
phenomena in data processing systems in which a data signal interferes with itself at a 
destination. The present invention also relates to the use of reliable symbols to 
determine values of source symbols that are corrupted by ISI. The present invention 
finds particular application in systems where source symbols are members of high-order 
constellations. Previously, such systems have required the use of training symbols for 
operation in the presence of real-world ISI phenomenon. 

FIG. 1 illustrates an exemplary data processing system 100 in which ISI may 
occur. A source 110 may generate a data signal D (herein, a "source data signal"). 
When delivered to a destination 120 as a received signal X, the source data signal D 
may be corrupted by ISI sources within a channel 130. For example, multiple copies of a 
single data signal D may be captured at the destination 120, each copy being received 
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with an unknown time shift and gain with respect to the other copies. Further, the time 
shifts and gains may vary over time. 

ISI phenomena may be modeled mathematically. In the case where the data 
signal D is populated by a number of data symbols d n , captured signals x n at the 
destination 120 may be represented as: 

x n = a 0 ■ d n + f (d n _ K2 , • • • , d n _! ,d n+1 , • • •, d n+Kl )+co n , ( 1 ) 

where a 0 represents a gain factor associated with the channel 130, f(d n _ K2 ,...d n+K J is a 

functional representation that relates the ISI to the symbols, d n _ K2 ,...d n+Ki , causing ISI 

corruption and represents corruption from other sources. In linear systems, Equation 
1 may reduce to: 

x n =d n + £ai-d n -i+» n > (2) 

where a _ Ki ,...a K2 represent the sampled values of the impulse response of the channel. 

In accordance to common practice, the values a, have been normalized by the value of 
a 0 in Equation 2. 

ISI is seen as a serious impediment to the use of high-order constellations for 
data processing systems. A "constellation" is a set of unique values (constellation 
points) that may represent data symbols. Higher order constellations define a greater 
number of constellation points than lower order constellations. For example, symbols 
from a binary constellation, one having only two constellation points, can represent only 
a single digital bit per symbol. By contrast, symbols from an eight-point constellation, a 
sixteen-point constellation or a 256-point constellation can represent three, four or eight 
digital bits per symbol. At a common symbol rate, these higher order constellations can 
yield higher data throughput than lower order constellations. 

Unfortunately, blind equalization (equalization without either an initial training 
sequence, or 'refresher' training sequences) is very hard to achieve with higher order 



373342_1.DOC 



Page 2 of 36 



11927/46101 



constellations. The detrimental effects of ISI increase with increasing constellation 

K 2 

order due to a greater contribution from the £ a i -d n _j term of Equation 2 

17] The inventors' co-pending patent application entitled, "Reliable Symbols as a 

Means of Improving the Performance of Information Transmission Systems," filed April 
18, 2001 having serial no. 09/836,281, discloses several techniques for blind 
estimation of ISI in transmission systems using high-order constellations. The invention 
described herein and the work presented in the inventors' co-pending foreign 
applications are believed to be the first practical blind equalization techniques suitable 
for high-order constellation data systems. The inventors believe that the disclosures 
herein and the methods described in the co-pending patent applications enable an 

0 increased number of reliable symbols to be obtained from captured samples and that 
this increases the rate and effectiveness of equalization. 

1 BRIEF DESCRIPTION OF THE DRAWINGS 

[81 FIG. 1 illustrates an exemplary data processing system in which ISI may occur. 

[f] FIG. 2 is a block diagram of an equalizer according to an embodiment of the 

O present invention. 

[jfp] FIG. 3 illustrates several embodiments of framing according to the present 

invention. 

[1 1] FIG. 4 is a block diagram of an equalizer according to another embodiment of the 

present invention. 

[12] FIG. 5 is a block diagram of a receiver structure according to an embodiment of 

the present invention. 

DETAILED DESCRIPTION 

[13] Embodiments of the present invention provide fast equalization techniques for 

systems using high-order constellations where symbols have been corrupted by ISI. The 
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technique allows ISI estimation to begin immediately upon receipt of captured samples. 
ISI estimation is weighted according to a reliability factor of each captured sample. 

[14] FIG. 2 is a block diagram of an equalizer 200 according to an embodiment of the 

present invention. The equalizer 200 may include a symbol decoder 210, an ISI 
estimator 220 and a pair of buffers 230, 240. The symbol decoder 210 may estimate 
decoded symbols d n from a sequence of captured samples x n based on a current 
estimate of ISI coefficients (labeled {aj in FIG 2). Decoded symbols d n may be stored in 
a first buffer 230; captured samples x n may be stored in a second buffer 240. The ISI 
estimator 220 may generate new estimates of the ISI coefficients {a { based on the 

symbols d n and samples x n from the buffers 230, 240. 

[&>] The equalizer 200 shown in FIG. 2 advantageously permits decoding to occur 

(S immediately upon receipt of captured samples x n even before an accurate estimate of 
the ISI coefficients ^ are available. Thus, the decoded symbols d n output by the 

5 <g symbol decoder 210 may have large error initially. Over time, however, as more 

W decoded symbols d n become available, the ISI estimator 220 may develop increasingly 

P improved estimates of the ISI coefficients and improve the accuracy of the decoded 

p symbols d n estimated by the symbol decoder 210. 

i Si" 

[t€] ISI ESTIMATION USING RELIABILITY WEIGHTING 

[17] Having estimated decoded symbols d n from the captured samples x n , the ISI 

estimator 220 may revise ISI coefficient estimates. To simplify the nomenclature 
herein, consider a case where the buffers 240, 230 respectively store a predetermined 
number L of samples x n and decoded symbols d n (n=l to L). 

[18] In an embodiment, the ISI estimator 220 may employ a least squares estimation 

to update the ISI coefficients according to: 

{a} = (H T WH)" 1 H T WA (3) 
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where: {a} is a vector of estimated normalized ISI coefficients, a is a vector that 
contains elements A n =x n -d n , representing the difference between the received 
samples x n and the related decisions d n , H is an LxK matrix containing surrounding 
symbol estimates, and W is an LxL diagonal weight matrix having weights w nn that are 
derived from a reliability factor of an associated captured sample x n (Wj ( pO for all i^j). 
The weight may increase or remain constant with decreasing reliability factor. 

In an embodiment, the H matrix may be populated by symbol estimates obtained 

from the symbol decoder. It may be constructed as an LxK matrix in which each of the L 
rows contains symbol estimates surrounding the estimated symbol to which the row 
refers. For example, an i th row may relate to a symbol estimate d,. In a simple 
embodiment, where ISI is known to occur from symbols on only one side of the decoded 
symbol d i7 the i th row may contain the symbol estimates H = {d, _K'dj_(K_i),-" f dj_i j. In the 
more general case, where ISI may occur from symbols on both sides of the decoded 
symbol d,, the i th row (H.) may contain the symbol estimates 



number of adjacent symbols that are expected to contribute to ISI corruption. 

During ISI estimation, different samples x n may be assigned relative weights 
based upon associated reliability factors R(x n ) of the samples. In a first embodiment, a 
weight w n>n may be assigned according to a binary weighting scheme. If the reliability 
factor of a sample is equal to or less than a predetermined threshold, the weight w n , n 
may be assigned a first value, otherwise the weight may be a second value. For 
example: 



In this embodiment, a sample x n contributes to ISI estimation if and only if it is a 
reliable symbol. 




K, the width of the H matrix, may be determined by the 




(4) 



373342_1.DOC 



Page 5 of 36 



11 927/4-61 01 



Alternatively, all samples may contribute to ISI estimation, weighted according to 
their reliability factors. For example: 



In this embodiment, even those samples x n that do not meet the criterion for reliability 
may contribute to the ISI estimation. However, the contribution of samples with very 
high reliability factors will be much lower than samples with very low reliability factors. 
In other words, reliable symbols have greater contribution to ISI estimation than 
samples that are non-reliable. 

In another embodiment, all samples may be permitted to contribute to the ISI 
estimate but reliable symbols may be given a very large weight in comparison to non- 
reliable samples. For example: 



im 



l:R(x n )<d, 

* -:else ^ 



R(x n ) 

where f is a ceiling factor that prevents -J-^r from exceeding 1 for all non-reliable 

R(*n) 

samples. In this embodiment, any sample that meets the criterion for reliability may be 
assigned a predetermined weighting value ("1" in the example of Equation 6). All 
reliable symbols would be equally weighted in the ISI estimation. Any sample that fails 
the criterion for reliability may be assigned a weight that is proportional to its calculated 
reliability. 

CALCULATION OF THE RELIABILITY FACTOR RfX n) 

The inventors' prior application describes several alternative techniques for 
calculating the reliability factor R of a sample x n . They include: 

R(x n )= SM'Ci (7) 

where Ki, K 2 represent the numbers of samples adjacent to sample x n that may 
contribute to ISI corruption. The values c t are constants representing any priori 
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knowledge of the ISI effect that may be available. Generally, if nothing is known about 
the ISI, then the c,'s may all be set equal to 1. In other situations, additional information 
as to the nature of the channel 130 may be known and the c,'s may be given values 
reflecting this information. 

[25] Where samples on only one side of a sample x n contribute to the ISI effect, the 

reliability factor of the sample x n may be calculated according to: 

R(x n )=£|xn-ii*Ci ■ (8) 
i=l 

where K=K 2 in Equation (2). In respect to the forgoing reliability factors (Equations (7) 
and (8)) the x n 's may be real for one-dimensional signal structures or complex for two- 
dimensional signal structures. 

[^6] For systems using two-dimensional constellations, such as QAM constellations, 

^ the reliability factor may be determined using: 



R(x n )= t M +4 -Cj (9) 
j== _ Ki v ^ 

where x ln and x 2n _ ( respectively represent values of x n ., in the first and second 
dimensions. 

Alternately, the reliability factor R may be calculated from values, d n , of the 
decoded symbols at the output from the symbol decoder 210. In this embodiment, the 
evaluation of Equations 7 to 9 may be carried out as follows: 

R(x n )= I d n _i -Cj, (10) 

1*0 



R(x n )= I 

and 



i*0 



dn-i 



Cj, (11) 



R(x n )= I JdJ +d\ . Ci (12) 



! = n Kl 
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respectively. In Equation 12, the parameters and d 2 respectively represent values 
of d n _j in first and second dimensions. 

The predetermined threshold d hm may be determined based on the applications 
for which the identification method is to be used. In one embodiment, the threshold 
may be set to the value d hm =(k x +K 2 ).d min where d mm is half the distance between two 

constellation points that are closest together. This threshold is appropriate for the case 
1 k 2 

wnere tti IN Experiments have shown, however, that operation can be maintained 

| a 0| i=-K x 

i.O 

1 K 2 

using the same threshold when y=- £|aj| < 1.4 . 

l a o| i=-Kj 

The threshold d|, m also may vary over time. If the predetermined threshold is 
increased, then an increased number of samples will be accepted as reliable symbols 
though, of course, all of these symbols will not be of the same reliability. Similarly, by 
decreasing the threshold d|, m , the number of samples that are designated as reliable 
symbols will decrease. These symbols will be those symbols with lower reliability 
factors. During operation of a reliable symbol detection method, the threshold d hm may 
be varied to maintain a rate of detected reliable symbols at a desired value. For 
example, if a rate of detected symbols falls below a first rate threshold, the d hm value 
may be increased. Or, if the rate of detected symbols exceeds a second rate threshold, 
the diim value may be decreased. 

In a case where captured samples x n may suffer a carrier phase rotation with 
respect to the source symbols d n , the threshold d )im may be set according to half the 
width of an annular constellation ring in which the captured sample x n is observed. 
Further details of the constellation rings are available in the inventors' earlier-filed 
patent applications and are incorporated herein by reference. 
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FRAMING 



The foregoing discussion has described ISI estimation from a predetermined 
number L of samples x n and d n . This predetermined number L implies the use of 
frames. While the adaptation process described above may be performed on a frame-by- 
frame basis, additional benefits may be obtained with more sophisticated use of these 
frames. 

FIG. 3 illustrates several framing schemes applicable for use with the present 
invention. In a first embodiment, shown in FIG. 3 (a), frames of uniform length L may be 
processed sequentially. That is, ISI estimation may commence using a first frame 310 of 
L samples x n and symbols d n . Following processing of the first frame 310, the ISI 
estimation may continue using a second frame 320 of L samples x n and symbols d n . 
The samples x n and symbols d n from the first frame 310 may be omitted from the 
adaptation analysis of the second frame 320. Additional frames 330-350 may be 
processed sequentially for as long as captured samples x n are available to the equalizer 
200. The embodiment of FIG. 3 (a) may be advantageous for use in applications where 
ISI coefficients are expected to fluctuate over time. 

A second embodiment, shown in FIG. 3 (b), may employ overlapping frames of 
uniform length L. ISI estimation may commence using a first frame 360 of L samples x n 
and symbols d n . Following processing of the first frame 360, the ISI estimation may 
continue using a second frame 370 of L samples x n and symbols d n . In this 
embodiment, certain samples x n and symbols d n from the first frame 360 may be 
members of the second frame 370. Thus, these samples x n and symbols d n may be 
used for ISI estimation for multiple frames. Additional frames 380-410 may be 
processed using similar techniques. Thus, for the third frame 380, certain samples x n 
and symbols d n from the second frame 370 may be retained for the ISI estimation 
process. The embodiment of FIG. 3 (b) may provide a smoother estimate of the 
fluctuating ISI coefficients. 
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A third embodiment, shown in FIG. 3 (c), may employ a series of frames having 
frame lengths that increase from a minimum frame length L min to a maximum frame 
length L m ax. In this embodiment, ISI estimation may commence using a first frame 420 
of Lmin samples x n and symbols d n . Thereafter, ISI estimation may continue using a 
second, larger frame 430 of L 2 samples x n and symbols d n . The second frame may 
include samples x n and symbols d n from the first frame. Following processing of the 
second frame 430, ISI estimation may be performed on successively larger frames of 
samples x n and symbols d n until a frame 440 of maximum length, L maXf is processed. In 
an embodiment, following processing of the largest frame 440, the ISI estimator 230 
may process a new frame 450 of minimum length L min and repeat the sequence of 
frames 440-460 having progressively larger lengths as described above. Alternatively, 
having processed a frame 440 of maximum length L ma x the ISI estimator 230 may 
continue to process new frames of the maximum length 460 sequentially in a manner 
analogous to that shown in FIG. 3 (a). 

FIG. 3 (d) illustrates yet another embodiment of framing. In this embodiment, ISI 
estimation may commence using a frame 480 of L samples x n and symbols d n . 
Thereafter, ISI estimation may continue using a second frame 490 of samples x n and 
symbols d n . This second frame 490 may include a new set of L samples x n and symbols 
d n and any samples x n and symbols from the first frame 480 identified as being reliable 
symbols. In the example of FIG. 3 (d), the second frame 490 is shown as including three 
reliable symbols from the first frame 480. Thereafter, processing may advance to a 
third frame 500 which might include a new set of L samples and symbols as well as any 
samples and symbols from the second frame 490 that are deemed to be reliable. Of 
course, there is no requirement that a frame 500 include reliable symbols only from the 
immediately preceding frames of samples. In alternate embodiments, a frame may 
include reliable symbols from one or more preceding frames of samples; this 
embodiment is illustrated in FIG. 3 (e). 

In another embodiment, adaptation may occur on a sample-by-sample basis. In 
this case, "frames" may have an overlap of L-l samples. 
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Identification of reliable symbols may occur according to any of the techniques 
described in the inventors' prior application. For example, if the reliability factor R(x n ) is 
less than or equal to a limit value d|, m , the sample x n may be a reliable symbol. In the 
equalizer 200, reliability factors may be calculated according to any of the techniques of 
Equations 7-12 and, in appropriate embodiments, of Equations 14-16 below. 

ALTERNATIVE EQUALIZER STRUCTURES BASED ON RELIABLE SYMBOLS 

Returning to FIG. 2, an embodiment of the equalizer 200 optionally may include a 
reliable symbol detector 250 (shown in phantom) to enable the symbol decoder 210. 
The reliable symbol detector 250 may accept input samples x n and identify which of 
them, if any, have reliability factors sufficient to qualify them as reliable symbols. In this 
embodiment, the reliable symbol detector 250 may generate a control signal En that 
enables the symbol decoder 210 upon detection of a first reliable symbol. In this 
embodiment, the reliable symbol detector 250 inhibits operation of the equalizer 200 
until a first reliable symbol is detected from the sequence X of captured samples. 

Although the foregoing embodiments have described the equalizer 200 as 
employing a purely blind equalization process, the present invention does not preclude 
use of training symbols. Training symbols may be a transmitted to provide at the 
destination 120 a number of received samples that can be used as alternatives to 
reliable symbols. Following receipt of the training symbol samples, the equalizer 200 
may process other samples x n in a blind fashion as described in the foregoing 
embodiments. This embodiment represents an improvement over other equalizers for 
high-order constellations because, even though training symbols would be used in the 
present invention, the training symbols would be of reduced number as compared with 
known systems. Such a short training sequence may not be of sufficient length to allow 
complete equalization of the channel but may allow ISI adaptation to begin. In such an 
embodiment, if successive groups of training symbols are used the period between 
groups of training symbols may be long compared to the dynamics of the channel and 
the present invention would continue to equalize the channel during the period between 
training samples. 
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[42] FIG. 4 is a block diagram of an equalizer system 600 according to another 

embodiment of the present invention. In this embodiment, the equalizer system 600 
may perform ISI estimation without outputting estimated symbols d n from the equalizer 
until the ISI estimation reaches a convergence, that is until ISI estimation error is below 
a predetermined threshold. This embodiment may include a symbol decoder 610, an ISI 
estimator 620 and a pair of buffers 630, 640 that operate in accordance with the 
embodiments described above. For example, the ISI estimator 620 may apply 
adaptation weights w n , n to sample-symbol pairs based on reliability factors of the 
samples/symbols as described above. The equalizer 600 also may include a selector 
650 and a gate 660. 

[43] According to this embodiment, the selector may be connected both to an original 

p input 670 of the captured samples x n and to the buffer 640. The selector 650 may be 
I| controlled by a CONVERGENCE signal output from the ISI estimator 620. When the 
CONVERGENCE signal indicates that the ISI estimation has not converged, the selector 
m 650 may pass samples x n from the input 670 to the symbol decoder 610. When the ISI 
;P; signal indicates that the ISI estimation has converged, the selector 650 may pass 
3 samples x n from buffer 640 to the symbol decoder 610. 

(0] The gate 660 may be coupled to an output of the symbol decoder 610 and also 

*0 may be controlled by the state of the CONVERGENCE signal. When ISI estimation has 
)2 not yet converged, the gate 660 may be rendered non-transmissive and may block 
decoded symbols d n from being output from the equalizer 600. When the ISI estimation 
does converge and the symbol decoder 610 decodes captured samples x n from the 
buffer 640, the gate 660 may become transmissive and the equalizer 600 may output 
the decoded symbols d n . 

[45] This embodiment may be advantageous for use in applications where ISI is not 

expected to fluctuate wildly over the course of several frames. If, for example, it takes 
20 frames for an ISI estimation to converge and if it is expected that the estimated ISI 
coefficients govern the first frame of captured samples, then all 20 frames may be 
decoded using the ISI estimate, once the estimate has converged. In this case, these 20 
frames may be retrieved from the buffer 640 and decoded. The decoded symbols that 
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are obtained from the converged ISI estimate are likely to be more accurate than the 
decoded symbols that were generated by the symbol decoder 610 prior to convergence. 
Of course, after the 20 exemplary frames are decoded, the selector 650 may switch back 
to the input 670 and permit the symbol decoder 610 to decode newly received samples 
x n . 



[46] THE SYMBOL DECODER 

[47] The Subtractive Equalizer 

[48] Several embodiments of symbol decoders 210, 610 may be employed for use in 

the equalizers of FIGS. 2 and 4. A first embodiment is shown in phantom in FIG. 4. The 
symbol decoder 610 may include a subtractive equalizer 680 and a hard decision unit 

O 690. In one embodiment the subtractive equalizer 680 may generate a re-scattered 

m sample y n from the captured sample x n according to: 

m Yn =x n -Xaj-d n _j (13) 

'% i=l 

where coefficients a, represent a current ISI estimate and d m represent previously 
5*^ decoded symbols. Initially, for the first frame, the ISI estimate may be set arbitrarily, 
O such as aj =0for all i. Also, the d n .j that antedates the first captured sample may be set 

: fH 

Q arbitrarily, such as d n .j =1. The hard decision unit 690 may generate decoded symbols 
d n from respective re-scattered samples y n . For example, the hard decision unit 690 
may generate a decoded symbol d n as the constellation point closest to the re-scattered 
sample y n . 

[49] In an embodiment where the symbol decoder 610 includes a subtractive 

equalizer 680 and a hard decision unit 690, ISI estimation may be performed using the 
re-scattered samples y n rather than the estimated symbols d n . ISI coefficients may be 
estimated according to the techniques disclosed in Equation 3 but, in this embodiment, 
the vector a may represent differences between the received samples x n and the re- 
scattered samples y n (An={x n -y n }) and the matrix H may contain surrounding re- 
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scattered samples. In this embodiment, re-scattered samples y n from the subtractive 
equalizer 680 may be input to the ISI estimator 620 instead of the estimated symbols 
d n (shown in phantom in FIG. 4). 



In this embodiment, the H matrix may be populated by re-scattered samples 
obtained from the subtractive equalizer. Each row of the matrix may contain re-scattered 
samples surrounding the sample to which the row refers. For example, an i th row may 
relate to a symbol estimate y\. In a simple embodiment, where ISI is known to occur 
from symbols on only one side of the rescattered sample y„ the i th row may contain the 
rescattered samples H. = {y i _ K ,yj_( K _ 1 ),---,y i _ 1 }. In the more general case, where ISI may 

occur from symbols on both sides of the rescattered sample y„ the i th row may contain 
the rescattered samples H. =^|_ K2 ,...,y i _ 1 ,y i+1 ,... I y i+Ki . K, the width of the H matrix, may 

be determined from the number of adjacent symbols that are expected to contribute to 
ISI corruption. 

In such an embodiment, the reliability factor R also may be calculated from 
values of the rescattered samples y n . The evaluation of Equations 7 to 9 may be carried 
out as follows: 

ROn)= I|y n -i|-Ci, (14) 

;=-k, 

i*0 

R(x n ) = E|y n -i|-Ci , and (15) 

R On)= I Jvi +Y2 -q (16) 
i*0 

respectively. In Equation 16, the parameters y^ and y 2 respectively may represent 

values of y n _, in first and second dimensions. Weighting during ISI estimation also may 
be based on reliability factors calculated from rescattered samples y n . 

In an embodiment the subtractive equalizer 680 may be used for a feedback filter 
in a decision feedback equalizer (DFE). 
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[53] Symbol Detection Using Maximum Likelihood 

[54] In other embodiments, a symbol decoder 210 (FIG. 2) may operate according to 

the well-known maximum likelihood estimation framework. The captured sample x n may 
be given by Equation 2 above: 

K 2 

*n =d n + Ia r d nH +® n (17) 

The maximum likelihood estimate of the transmitted signals {d n } conditioned on the 

observations {x n } may be given by maximizing the likelihood of the observations. This is 
simply the conditional probability of the captured sample x n conditioned on knowing the 
past transmitted signals {h*} and the ISI coefficients {aj}: 

3 dff L = {h* : maxPr(x n | a if ) i e [-K x ,K 2 ],i *0;hU D)} (18) 

[^p] Finding the maximum likelihood estimate of the present transmitted signal d n 

IS. depends upon knowledge of both the past transmitted signals and the ISI coefficients 
|f| {a n }. The probability density function of x n given {d n } and {a,} is simply the probability 
density function of the noise evaluated at: 

« = x n "d n - 2>id n -i (19) 

o 

f56] Then, the probability density function of Equation 19 can be expressed in terms 

of a series of further conditioned probability functions, which leads to: 



Pr(Xnlh^) = E "EE" E JP^n-VK^-'^l'Vl-^n-K,^'^) 1 : 

h n-Ki h l h -l h n-K 2 § 2 

= S JPrx ni D^,a|h^a 

D n_K2 a 



-'n+K 1 § 

where £ f 0= E "E E** E f 0 denotes the whole set of summation of the function, f(-), 

D n " K 2 h k h k h k h k 

U n+Ki 'Wi n n+l M n-1 n n-K 2 

each summation running over the whole set of possible constellation points, and 
D n+K* = 't h n+K 1 '-* ,h n+i jh n-i'"' h n-K 2 ^ denotes the set of the M Kl+l<2 possible sequences of 
possible values for the surrounding symbols.. This technique averages over all possible 
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past transmitted sequences. The technique also renders lack of knowledge of the ISI 
coefficients inconsequential, assuming, of course, that the probability distribution of the 
ISI coefficients is known instead. In what follows the ISI distribution is taken to be a 
uniform distribution 

The compound probability rule states that Pr(A,B) = Pr(A |B)Pr(B), which after some 
straightforward manipulation provides the following for Equation 20: 

Pr(x n |h*)= I JPr(x n I hK ,a,Dj;j^ )pr(a)Pr^;^ )te (21) 

where, Pr(a) is a probability density function (pdf) associated with the ISI coefficients, 
and Pr(D^~£ 2 ) is a pdf associated with the related surrounding symbols set. 

Assuming additive white Gaussian noise of zero mean and variance <r 2 , then the 
standard probability density formula for Gaussian noise may be applied: 

Pr(x n |h*)= I \-?=* ^ p r ^)p r ( D ^Jba. (22) 

Finally, for the re-scattered received signal: 

( f 
x n - la^-hS 

,=-Ki 

Pr(x n |h^ 2 j^=L=e 2? Pr(a)Pr(D^)da (23) 

D^aV2^a 2 

where the decision to the received symbol is carried through: 

d n ={h^:maxPr(x n |h^D)}. (24) 

Equation 23, called the "average likelihood" estimation of a hypothesis symbol h k 
at time n, serves as a basis for decoding symbols. In essence, Equation 23 takes 
captured signal samples x n and removes the effects of ISI through re-scattering, 

K 2 

accomplished through the second term of the exponential (- £ a:h _.). At a 
destination, for each sample x n , Equation 23 may be performed for every point h£ in the 
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governing constellation. A decoded symbol d n may be estimated as the point hp having 
the largest probability of occurrence. 



The evaluation of Equation 23 is believed to provide near optimal symbol 
detection when the ISI coefficients and the transmitted data are unknown. However, it is 
very difficult to implement in a real-time computing device. Accordingly, other 
embodiments of the present invention are approximations of the evaluation of Equation 
23 that are computationally less complex. These embodiments are discussed below. 

Symbol Decoding Using Trellis Based Detection 

In another embodiment of the symbol decoder 210, when decoding a sample x n , 
probability estimations generated from the surrounding symbol samples x n -i to x n .N may 
be used. Thus, probabilities for all possible transmitted symbols, 

Pr^x n _j h n j e D^j, V i e [-K lf K 2 ],i * 0 , may be stored for the surrounding symbols. Where ISI 

coefficients are known to be real, these probabilities represent Vm 1 2 branches in a 
trellis (i.e. possible combinations of surrounding symbols). For complex ISI coefficients, 
the trellis may include M Kl+l<2 branches. The probability of an m th branch in the trellis 
D n+Ki ma y represented as: 



ftPrfrn-i|h n .,) (25) 



1*0 

More conveniently, the calculation may be evaluated for the logarithm of the 
probabilities (and later converted back to a probability form), 

I log(Pr(x n _i|h nH )) (26) 

Either of these results may be used with a trellis decoder to obtain the likelihood-based 
estimate for d n according to Equation 23. 

Symbol Decoding Using ISI Coefficient Statistics 
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Statistical distributions of the ISI coefficients may yield further computational 
simplifications according to an embodiment of the symbol decoder 210. Unless 
otherwise known, in this embodiment, the ISI coefficients may be considered to be 
uniform over their specified ranges fa R ,-",a R , f aF, — ,a!* • In this case, Equation 23 

becomes: 



Prl 



(x n |hn)= fl 



f \ 
1 



V i J 



1 



DS^aV2^ 2 



x n - la^.-K 
2a 2 



(27) 



Since the constant J] 



f \ 
1 



i*0 



Vi J 



is independent of h„ , it may be omitted from calculation. 



Symbol Decoding Using Past Decisions 

In the embodiments discussed previously, Pr(o^ 2 ) represents the probability of 

the various possible symbol sequences that can result in the observed sample x n . The 
symbol decoder 210 embodiments discussed previously rely upon a maximum 
likelihood when considering a sample at time n, each of the symbols d n _j were 
generated from the maximum probabilities at the previous iterations. In an embodiment 
in which Ki is not equal to zero but where its contributions may be neglected; rather 
than calculate P^"^) anew for each sample x n , the most likely symbol sequence may 

be assumed to be symbol sequence D^-i 2 ^ at inc l u des the previously estimated 

symbols D = ^ n _ 1( -,d n _ K2 } that is, it may be assumed that Pr(D"~* 2 =Dj^ 2 )s 1. 
Therefore, Equation 27 may be simplified further: 



Pr 



(xnK)-n 



V i J 



K 2 - h 

x n -la,d nH -h; 
1=1 

2? 



da, 



(28) 
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Again, the constant n 




is independent of h£ and may be omitted from calculation. 



Eliminating ISI Ranges in Symbol Decoding 



Another embodiment of the symbol decoder 210 simplifies the evaluation of 
Equation 23 by using the estimate of the ISI coefficients, a s . I n this embodiment, symbol 
estimation may occur according to maximum likelihood estimation of: 



i=l 

Because of the minus sign in the argument of Equation 29, the estimation may become 
a minimum likelihood analysis: 



It can be observed that this is in fact the subtractive equalizer discussed in Paragraphs 
41-44 

USING 'RELIABLE SYMBOLS' FOR ESTIMATION 

According to an embodiment, identification of a reliable symbol may be made 
based upon re-scattered symbols y n rather than the captured samples x n . During 
operation of the equalizer 200, after an arbitrary number of iterations, the equalizer 200 
may produce a set of ISI coefficient estimates, a Sj each with an associated error, a ]f 
such that, 




(29) 




(30) 



a; + a; . 



(31) 



The partially equalized signal may be written as: 



y n 




n-i • 



(32) 



Substituting into Equation 2 yields: 
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(33) 



which by examining Equation (28) and defining the error of the estimated symbol as 
dj =dj +dj, Equation (30) becomes, 



This is a generalization of Equation 2, where the ISI estimates are completely unknown, 
so that y n = y„ and a s = -a- } . 

From Equation 34, the residual ISI on the partially equalized symbol point, y n , 
becomes the inner product of the surrounding data symbols with the ISI error 
coefficients, a f , and an additional inner product of the decision errors and the ISI 
coefficients. Since the ISI error coefficients are smaller then the ISI coefficients, 
surrounding symbols with higher energy will contribute less to the ISI than they would 
under the structure of Equation 2. Thus, the probability of identifying a sample as a 
reliable symbol increases, even though the energies of surrounding symbols can be 



large. As the quality of the estimate increases, the inner product £ajd n _j wi" remain 

1*0 

acceptably low even for surrounding symbols of relatively high energy. 

FIG. 5 is a block diagram of a receiver structure 700 according to an embodiment 
of the present invention. The receiver 700 may include a demodulator 710, a memory 
720 and a processor 730. FIG. 5 illustrates communication flow among the 
demodulator 710, the memory 720 and the processor 730, not actual electrical 
interconnections among these units. 

The demodulator 710 may capture a signal from a channel and from which, 
captured samples x n may be generated. The channel may be an electric, magnetic, 
optical or acoustic propagation medium. Demodulators 710 for capturing such signals 
are well known. The captured samples typically have no detectable correspondence to 
points of the governing constellation. They may take any number of values between the 



y n =d n - 



K 2 „ 

E a id n -i - 




k 2 _ 



(34) 
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constellation points (e.g. 6.3, 6.5, -3.1). Captured sample data may be stored in a buffer 
722 in the memory 720. 

The memory system 720 may be logically organized to perform storage functions 
for the receiver 700 to operate as an equalizer. A first area 722 of the memory may 
store captured samples x n for further processing. This area 722 may constitute the 
frame buffers 240, 640 described with reference to FIGS. 2 and 4. Of course, the area 
722 may be provisioned to be much larger than the frame sizes if it is desired to re- 
estimate samples from the early frames after ISI convergence as described in FIG 4. A 
second area 724 of the memory 720 may store the decoded symbols d n . And, of 
course, a third area 726 of memory 720 may store program instructions. The memory 
720 actually may be an integrated memory system and may be populated by electric, 
magnetic or optical memories or other storage elements that may be configured as a 
read-only memory (ROM) or random access memory (RAM). 

As dictated by the instructions, processor 730 operation may be divided logically 
into functional units including a reliable symbol detector 732, a symbol decoder 736 
and an ISI estimator 734. The processor 730 may be a general-purpose processor, a 
digital signal processor or a collection of processing elements. Alternatively, the 
functional units 732-736 may be discrete processing circuits of an application specific 
circuit or other hardware system. 

Several embodiments of the present invention are specifically illustrated and 
described herein. However, it will be appreciated that modifications and variations of 
the present invention are covered by the above teachings and within the purview of the 
appended claims without departing from the spirit and intended scope of the invention. 
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